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ABSTRACT 


Two  conditionally  heteroscedastic  autoregressions  are 
considered.  It  is  shown  that  under  suitable  conditions,  the 
processes  are  stationary  and  ergodic,  and  that  the  stationary 
initial  distribution  can  be  represented  by  a  nonlinear  function 
of  independent,  identically  distributed  standard  Normal  random 
variables. 
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1.  Introduction 

Autoregressive  moving  average  (ARMA)  models  are  rou¬ 
tinely  used  in  time  series  analysis,  particularly  since 
tr.f  publication  of  Box  and  Jenkins’  (  1  )  book  which  set 

methods  for  the  identification,  estimation  and 
..  ..sric  checking  of  these  models.  There  is,  however, 

:  reason  to  suppose  that  every  process  can  be  reduced  to 
one  which  is  adequately  represented  by  a  linear  model. 

Despite  this,  the  linearity  assumption  is  seldom  questioned. 
The  lack  of  useful,  nonlinear  alternatives  to  the  ARMA  model, 
with  the  exception  of  Granger  and  Andersen's  (  5  )  bilinear 

ARMA  (BARMA)  model,  left  few  options.  Recently,  however, 
Engle  (  4  )  introduced  a  new  class  of  nonlinear  models. 

Engle  (  4  )  observed  that,  given  the  past,  the  conditional 

variance  of  a  stochastic  process  is  not  necessarily  constant 
but  can,  in  general,  depend  on  past  observations.  Accord¬ 
ingly,  nonlinear,  conditionally  heteroscedastic  time  series 
models  ca^  be  derived  from  the  classical  models.  Although 
Ingle  only  r-'.  lied  one  specific  formulation,  conditional 
heterosceieeti: ity  is  a  general  property  and  can  be  used  to 
define  a  *~ri asy  of  nonlinear  models. 

In  _his  paper  two  conditionally  heteroscedastic  auto- 
regressions  are  considered.  Properties  of  the  models  are 
studied  and  simulated  sample  paths  are  presented.  It  is 
shown  that  under  simple  conditions  the  processes  are  station¬ 
ary  and  ergedic,  and  that  the  stationary  initial  distribution 


2 


can  be  expressed  in  terms  of  independent,  identically  distri¬ 
buted  (i.i.d.)  standard  Normal  (N(0,1))  random  variables. 

1  Conditionally  Heteroscedastic  Autoregressions 

-=  u  +...+  6  y.  +  6  +  be  a  p-tb  order,  zero 
autoregression  and  let  3"^.  =  fl'(y^.,y+_^l  . .  . )  be  the  sigma 
algebra  ge.'.eraoed  by  the  y^  1  s  up  to  time  t.  In  the  classi¬ 
cal  model  it  is  assumed  that  is  an  i.i.d.  sequence  of 

2  o 

N(0, cr6)  random  variables,  where  Cr6  ?0.  Consequently,  given 
the  conditional  mean  of  y^.  is  linear  in  y-t-1  >  •  •  •  » Yt-p 
and  the  conditional  variance  is  constant.  Now,  consider  as 
an  alternative  model  one  where  the  conditional  variance  de¬ 
pends  on  the  past  observations.  The  result  is  the  condi¬ 
tionally  heteroscedastic  autoregressive  (CHAR)  model: 

*'t  =  Vt-i  +---+4,pyt-P  +  e*  (2,la) 

is  given 

(2.1b) 

with  h^._j=h(y1._j_,y^_2»  .  .  .  ,y^_r;fi)  for  some  finite  r^-1 . 

The  function  h(  •  )  is  a  positive  function  of  y-t-i  »yt-2’ '  "  ’  1 
y and  0  is  vector  of  parameters. 

The  CHAR  model  is  obviously  nonlinear,  even  though  the 


where  the  iie-ribution  of  6^,  conditioned  on  J 


6tlh-l  ~  N(0,h,  ,) 


In  con- 


conditional  mean  is  linear  in  *  '  *  ’^t-p* 

trast,  the  nonlinearity  of  a  BARMA  model  is  the  result  of  a 
nonlinear  conditional  mean.  Engle  (  4  )  defined  a  general, 

o oitionally  heteroscedastic  regression  model  in  which  the 
regresr:ro  can  include  exogenous  as  well  as  lagged  variables. 

‘  '  of  the  n: radon  used  here  is  Engle's  and  some  of  the 

properties  which  hold  for  the  autoregression  also  hold  for  the 
more  general  regression  model  (see  Engle  (4)  ). 

The  CHAR  process  defined  by  (2.1a,b)  is  a  Markov  process 
where  the  order  depends  on  but  is  always  at  least  p. 

For  a  given  h^._^  it  will  be  necessary  to  check  whether  or  not 
the  process  is  stationary.  In  any  case,  it  is  easy  to  see 
that  E(6 . )=0,  for  all  t,  and  Cov(6  ,6  )=0,  for  s/t,  since 

l  S  X 

the  conditional  mean  of  6^  is  zero.  The  e^'s  are  uncor¬ 
related  although  they  obviously  not  independent.  Thus,  if 
the  ly^  process  is  stationary  and  has  a  finite  variance, 
the  autocorrelation  function  is  the  same  as  in  the  case  of 
i.i.d.  6_ ' s  l.s.,  the  autocorrelation  at  lag  j,  Jd,  is 
giver,  by 


O  _ 

J  j  -  ~ 


:rr(yt,yt  .)  ^0^...+  i  t' 


(2.2) 


-1  “1 

where  A19...,A  are  constants  and  G1  ,  ...,G  are  the  roots 
l  o  l  p 

of  the  characteristic  polynomial  $(  z)  =  l-^z- ,  .  .  -  with 

I G ±1  <  1 ,  i  =  l,2,...,p.  Furthermore,  the  unconditional  vari- 


p 

ance,  (Ty,  .is  given  by 

o-y  =  ':2'5) 

if  E(ht_1K«J. 

There  are  numerous  choices  for  the  conditional  variance 

h^_^.  However,  not  all  choices  lead  to  useful  models .  It 

is  desirable  to  choose  so  that  the  mode a  is  flexible 

enough  to  give  a  good  approximation  to  a  variety  of  processes 

v/hile  remaining  mathematically  tractable.  In  this  paper, 

2  2 

h^._1  is  assumed  to  be  of  the  form  ht-1=  aO  +  Ctlet-l+  •  ■  *  +<*k6t-k 

or  ht-i“/}o+/3l^lyt-l+‘  *  •+<^>yt-p^  *  The  corresPonding  models 
will  be  referred  to  as  CHARI  and  CHARII,  respectively.  The 

CHARI  model  is  a  special  case  of  Engle's  (  4  )  conditionally 

heteroscedastic  regression  model  and  the  CHARII  model  is  the 
time  series  analog  of  the  regression  model  in  which  the  vari¬ 
ance  depends  on  the  mean  (see  Carroll  and  Ruppert  (3)  ,  for 

example).  The  properties  of  the  CHARI  and  CHARII  models 
are  described  in  Sections  3  and  4.  Proofs  c:  the  two  ' 1 i : - 
rems ,  which  give  sufficient  conditions  for  the  staticr.a:"- _y 
and  ergodicity  of  the  processes,  are  provided  in  Seoul... . 


3.  The  CHARI  Model 

The'CHARI(p.k)  model  has  the  following  representation: 
Ch-RKp.k):  yt  =  l|)1yt_1  +  ...♦  4>pyt_p  +  et  (3.1a) 

et  =  («-0  +  “i6!-!  +•  •  •+  zt  (3-lb) 

for  some  fixed,  finite  k>0  and  ^  i.i.d.  N ( 0 , 1 ) . 

The  parameters  «-q,  ot^ ,  .  .  .  ,od^  are  nonnegative  with  <*0  stric  \ 
positive.  Engle  (  k  )  referred  to  the  process,  d 

fined  by  (3- lb),  as  an  "autoregressive-conditional-hetero- 
scedastic"  (ARCH)  process.  In  that  case  the  word  "autore¬ 
gressive"  refers  to  the  conditional  variance  structure  and 
should  not  be  confused  with  the  autoregression  in  (3- la)  or 
the  gener. 1  CHAR  process  given  by  (2.1). 

A  CHARI(p.k)  process  is  a  nonlinear  (p+k)-th  order 
Markov  process.  Typical  simulated  sample  paths  are  pre¬ 
sented  ir.  figure  1.  These  illustrate  the  "patchiness" 
which  is  characteristic  of  the  CHARI  process. 

Conditions  under  which  the  process  is  stationary  and 
ergodic  have  yet  to  be  determined.  It  is  obvious,  however, 
that  the  roots  of  the  characteristic  polynomial  $(z)  must 
lie  outside  the  unit  circle  since  this  is  required  for  the 
the  special  case  where  oti  =  a2=  •  •  •  =oqc=0 ’  corresponds  to 

the  usual  autoregression.  In  the  general  model  it  will 
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also  be  necessary  to  impose  restrictions  on  . *k 

ensure  the  stationarity  of  •  The  appropriate  condition 

holes  when  the  roots  of  the  characteristic  polynomial 


k  . 


Y*(  0  '  =1- c^z- .  .  .  lie  outside  the  unit  circle.  Combining 


gives  the  following  theorem.  A  proof  is 


or: vised  in  Section  5- 

Theorem  3.1:  (Stationarity  and  Ergodicity  of  the  CHARI(p,k) 
Process )  -  Let  (yj*0  be  a  CHARI(p.k)  process  with  COO  and 
et^O,  i=l,2,...,k.  Assume  that  all  the  roots  of  both  §(z) 

and  V(z)  lie  outside  the  unit  circle  and,  yQ,y^ . ^p-1 

and  . ek-l  have  finite  variances.  Then  Cy.J  is 

asymptotically  stationary  and  ergodic. 


Under  the  conditions  of  Theorem  3-l>  there  is  a  unique 

stationary  initial  distribution.  The  corresponding  station- 

T 

ary,  joint  density  function  for  (Yt-p-k+l’ yt-p-k+2’ ' ’ ' ’ yt^ 
is  the  nontrivial  solution,  ^^y-t-p-k+1’ *  '  ’  ,yt^  ’  ^n^e~ 

gral  equation: 

c 

f(y--P-k+i . y-t5  =  J 


X  exp[-ir^/(cd0+Klr2_1+...«kr2_k)J  f(yt_p_k . yt.j)  dyt_p_k 

(3.2) 

where  r^  =  y^- •  •  •  -<j)py^._p •  The  marginal  distribution 


of  y  +  ,  obtained  by  integration,  can  also  be  expressed  as  the 
distribution  of  a  nonlinear  function  of  i.i.d.  N(0,1)  random 
variables  (see  equation  (S.t3)  ir  the  proof  of  Theorem  3-1). 
Although  the  distribution  of  y^  is  symmetric  about  zero,  it 
is  obviously  aon-Gaussian  except  when  .  .  .~«t  --0. 

Unfortunately ,  (3-2)  appears  to  be  difficult  to  solve, 
even  in  the  simplest  case  with  p=k=l.  It  is,  however,  easy 
to  calculate  the  moments  of  6^  and  y^  by  using  the  condition 
al  Normality  to  evaluate  a  conditional  expectation  first. 
Since  the  distribution  of  y^  is  symmetric,  all  odd  power 
moments  exist  and  are  zero.  The  unconditional  variance  of 
6  can  be  found  by  solving  the  equation: 


=  E(e^)  =  E(h^._^)  =  °^o+ot'lE(fe t-l)  +  *  *  ' +ock^(fc t-k) 


Therefore , 

^6  =  ^l- •  •  •  -<^k^  (3*3) 

K 

where  and  substituting  into  (2.3)  gives  the  station¬ 

er  - 

ary,  unconditional  variance  of  y^ : 

& y  ~  <VE .  .-tk)(i- Vr*  •  Vp^ 

P 

where  .pi/i^l. 

Higher  order  moments  can  be  calculated  in  a  similar 


8 

fashion,  although  this  involves  increasingly  more  algebra. 
In  addition,  the  existence  of  higher  order  moments  requires 
increasingly  more  stringent  restrictions  on  the  parameters, 
so  _hat  the  only  case  where  all  moments  are  finite  is  the 

Gaussian  (  &'-=  .  .  .  -~c<k=0 )  case.  For  example,  when  p-k--l, 


^6  =  <*-q/  (  1  -  ) 

<Ty  =  Vh 

v/hich  are  both  finite  and  positive  if  *0>0,  1  andl<£I  41 

These  are  just  the  conditions  for  stationarity .  However, 

E(e  t>  =  E[E(4l3-t-l)]  *  3E[<wii)2]- 


Therefore , 


I  it:  =  3<*-q(  l  +  ^l  )/  [(  1-^)  (  1-3^)] 

_  1. 

v/hich  is  finite  and  positive  only  if  0^°^3  2- 

In  general,  when  p=k-l,  the  necessary  and  sufficient 

•  •  2  i 

condition  for  the  existence  of  E(6^  )  is 

.  J 

*JTT(2i-u  ^  i. 

i=J 


J  —  1  r  2  |  •  •  • 


(3-5) 


(Theorem  1;  Engle  (4)  ).  Since  E(y^.J  )  >  E(e^J),  (3-5)  is 

necessary  for  the  existence  of  E(y^  ).  As  j  increases 
r.u~T  decrease  and  in  the  limit,  <^=0  is  the  only  case  where 
all  moments  of  y  and  6.  exist.  Therefore,  the  density 

X  X 

functions  for  y  and  £  ,  generally  have  heavier  tails  the 

i>  X 


distribution.  Bounds  for  the  tails  can  be  obtained  by 

2  i  2  i 

nir.g  are  highest  value  of  j  for  which  E(y^  )  or  E(6^_  ) 


is  finite. 


The  CHARI  model  is  an  intuitively  reasonable  way  of 
modelling  conditional  heteroscedasticity  in  an  autoregression. 
Moreover,  simulated  sample  paths,  at  least  superficially, 
resemble  certain  time  series  in  their  patchy  appearance. 

There  are,  however,  other  equally  plausible  ways  of  modelling 
the  conditional  variance  of  an  autoregression.  One  obvious 
alternative  is  to  assume  that  the  conditional  variance  de¬ 


pends  direcmly  on  the  previous  observations.  In  particular, 
the  conditional  variance  may  be  directly  related  to  the  con¬ 
ditional  mean.  The  second  CHAR  model,  to  be  discussed  in 
the  next  section,  is  one  way  of  modelling  such  behaviour. 

A .  The  CHAR I I  Model 

The  CHARII(p)  model  can  be  represented  as  follows: 


CHARI  I  ( p ) :  yt  =  +...+ 4>pyt-p 


(4.1a) 


Figure 
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where  6t  =  [|S0  +  ft  t  (Vt-1+  *  •  •  +  ^t-p  )2J  *  zt  (4‘lb) 

ar.d  '.3^.}  ™  i.i.d.  K  ( 0 , 1 ) .  The  parameters  /3Q  and  are  non- 
neoutive  with  (h^  strictly  positive  to  ensure  a  positive  con¬ 
ditional  -ariar.co . 

A  CHAP.II  process  is  simply  the  time  series  analog  of 
tne  o.eteros : elastic  regression  model  in  which  the  variance 
is  proportional  to  the  square  of  the  mean  (see  Carroll  and 
Ruppert  (3)  ,  for  example).  Like  the  CHARI  process,  the 

CHARII  process  is  a  nonlinear  Markov  process  with  the  same 
linear  conditional  mean  as  the  classical  autoregression. 
Unlike  the  CHARI(p,k)  process,  the  CKARII(p)  has  the  same 
order,  p,  as  the  classical  autoregression.  Simulated  sample 
paths,  for  four  stationary  CHARII  processes,  are  shown  in 
Figure  2. 

Conditions  which  are  sufficient  for  the  stationarity 

and  ergodicity  of  a  CHARII (p)  process  are  derived  in  Section 

5  and  are  seated  in  Theorem  4.1.  As  before,  it  is  obvious 

that  the  rcous  of  the  characteristic  polynomial  $(z)  must 

lie  outside  the  unit  circle  for  the  process  to  be  stationary. 

Less  obvious  is  the  requirement  that  ( l  +  /3^ )  •  •  •  +4pfp) 

be  less  than  one,  where  Q.,  j=l,2,...,p  are  given  by  (2.2). 

^  J 


Theorem  4 . 1 :  ( Stationarity  and  Ergodicity  of  the  CHARII(p) 
Process)  -  Let  be  a  CHARII(p)  process  with  (3Q>0  and 

ft/?-".  Assume  that  all  the  roots  of  $(z)  lie  outside  the 

ur.i^  circle  and  y^.y^ . ^p-1  have  finite  variances.  Then 

\  y is  asymptotically  stationary  and  ergodic  if 
( 1  ^  ?]_+•  ■  •  where  fj  is  given  by  (2.2). 

There  is  a  unique  stationary  initial  distribution  when 
the  conditions  of  Theorem  4.1  hold.  The  density  function* 
f(y,  ,y+),  for  the  stationary  initial  distribution, 

X  '1  X 

can  be  found  by  solving: 

f(yt-p+i . yt-'  =/  C2'tr(<io+%'cl:iyt-i+---+Vt-p,2iJ’J 

—co 

X  exp[-l-r^/{/30^1(4,1yt_1+...+4pyt_p)2}j  f(yt_p . yt_1>  ayt_ 

(4.2) 

where  rt  =  i  t_  tpr  t-l“  ’  '  ’  t-p*  The  corresPondine  station¬ 
ary,  marginal  distribution  of  yt  can  be  represented  in  terms 
cf  a  nonlinear  function  of  i.i.d.  N(0,1)  random  variables 
(see  Equation  (S.Xi)  in  the  next  section). 

The  integral  equation  (4.2)  is  just  as  difficult  to 
solve  as  (3.2).  However,  moments  can  be  calculated  by  in¬ 
voking  the  conditional  Normality.  For  example,  the  variance 
Cr^,  of  a  stationary  CHARII(p)  process  can  be  evaluated  by 
substituting 
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E<ht-i>  3  Po  +P1  EMiyt-i*--'+Vt-p)2J 


=  /3 0  +/3l  'A?!  *■  ••tVp)<ry 


(2.3)  and  solving  for  to  give 

*7 


*v  =  /3o/[1-(1+/3l)^if1+*--  +  0pfp)] 


(4.3) 


where  ( 1  +  /3.,)  (  <j>j  .  .  +  <f)pfp)z  1  • 

In  general,  the  marginal  distribution  of  is  sym¬ 
metric,  but  not  Gaussian,  with  heavier  tails  than  Gaussian. 


All  odd  moments  are  zero,  by  symmetry,  and  E(y^J)  exists  and 


is  finite  for  a  finite  number  of  j,  unless  where  all 


2j.  . 


moments  exist.  The  maximum  value  of  j  for  which  E(yt  )  is 


finite  can  be  used  to  bound  the  tails  of  the  distribution  of 


yt.  On  the  other  hand,  if  E(y^)  is  finite,  for  a  given  j, 


then  certain  restrictions  on  the  parameters  are  implied. 

O  * 

For  example,  when  p=l,  E(y.J)*eo  implies  that 


1  -  <f 


(4.4) 


The  corresponding  regions  of  the  parameter  space  are  shown 


in  Figure  3.  f or  j=l,  which  implies  stationarity ,  and  for 


j=2,  which  corresponds  to  a  finite  fourth  moment  given  by 


E(yt)  -  [3/5o+6$2,'3o«-y(1+/!l)J/f1-^(1+6Pl  +  3Pl)] 


(P.5) 


When  j=2,  condition  (4.4)  ensures  that  the  denominator  of 
(4.5)  is  finite  and  positive. 

Theorems  3-1  and  4.1  are  proved  in  the  next  section, 
proofs  are  important  because  they  establish  the  conditions 
under  -..rich  the  CHARI  and  CHARI  I  processes  are  stationary 
srgodic  and,  in  doing  so,  characterize  the  stationary 
inixial  distribution.  Stationarity  and  ergodicity  are  fun¬ 
damental  properties.  In  practical  applications,  stationarity 
is  often  imposed  by  physical  constraints  on  the  process  pro¬ 
ducing  the  observations.  In  some  cases,  stationarity  is 
required  if  the  model  is  to  have  a  meaningful  interpretation. 
Furthermore,  the  assumption  of  stationarity  and  ergodicity 
is  central  to  statistical  inference,  including  parameter 
estimation.  Theorems  3.1  and  4.1  are  essential  to  the  in¬ 
vestigation  ar.d  application  of  the  CHARI  and  CHARII  models. 

5*  Proofs  of  Theorems  3-1  and  4.1 

Both  Theorems  3-1  and  4.1  are  proved  using  the  results 
of  Breiman  (  2)  which  demonstrate  that  the  stationarity 
and  ergodicity  of  a  Markov  process  depend  on  the  existence 
ana  uniqueness  of  a  stationary  initial  distribution.  It 
will  be  shown,  by  repeated  application  of  the  appropriate 
defining  equation,  (3-la,b)  or  (4.1a,b),  that  as  t-»<*>,  the 
limiting  distribution  of  y^  exists  and  is  independent  of 
the  initial  conditions.  This  distribution  is  the  unique 


stationary  initial  distribution  and  the  process  which  has  it 
as  its  initial  distribution  is  stationary  and  ergodic 
(Theorem  ?.l6,  Broiman  (.2)).  In  this  sense,  the  CHARI 

CHARII  processes  are  asymptotically  stationary  and  ergo¬ 
dic,  if  the  conditions  of  Theorem  3*1  or  4.1  hold. 


Proof  of  Theorem  3.1 

Consider  the  process  defined  by  (3. lb).  Repeated 

application  of  (3.1b)  gives: 


6k  -(*0+*l€k-l  +‘ *  *  +  °tk60^zk 


' k+1  [tt0+oii'^o+ctlek-l+*  *  ,+e6kfc0^zk+l/2ek-l  +  ,”  +  0tkel32zk+l 


j 


+  v; , iek-i  +' 


.  +  V 


,keo]2zk+, 


j=0,l, 


(5.D 


-•’here  the  rar. 


i:rr.  variables  u„,  and  v.  m  are  defined  recursively 
m  0  ,m  J 


jy  the  fo  Hewing  relations: 


0  0 


Tuozk 


^luk-lz2k-l  +  et2uk-2z2k-2  +' 


Vo’ 


(5.2) 


uj  =  Vj-lZk+j-l  +  Vj-2*k  +  j-2  +-"+  Vj-kzj 


ar._  for  m=l,2 . k 


1 ,  m  1  *. 


vk,m  "  ctlvk-l,mz2k-l  +  ^2vk-2 , mz2k-2  +  ‘*'  +  ®ScvO , i 


vj , m  “  aivj-l,mzk  +  j-l  +  *2V j-2,mzk+j-2  +  ,’,+  Vj-k,mzj 

j>k  J 

Equation  (5-1).  which  can  be  verified  by  induction  on  j ,  e 
presses  6k+j  in  terms  of  the  initial  values  '  £1  ’ ’ * ‘ ' £k- 
and  the  i.i.d.  N(0,1)  random  variables  zk , z^  +  1 » • • . . + j . 
for  j  =  0 , 1 . 

Note  that  the  random  variables  v.  ,  j-l,2,...,k  are 

j  9  in 

nor.r.egati ••e  f:r  all  j  and  from  (5-3)  it  follows  that  for 

~  -  -1  O 

ii*  —  X  f  f  •  •  •  -  -- 


E  ( v .  )  =  cc 

0 ,  m  m 


:(v  )  =  ^ECv  ) 

1 ,  m  1  u ,  m 


E(v.  „)  =  *,E(v.  ,  „)  +  <*„E(v.  o  _)  +...+  ot,_E(v.  .  „) 


where  (5-^)  holds  for  j^k  and  E(v.  ),  j^O.l . k-1,  are  ob 

viou.sly  finite.  Equation  (5-^)  -is  a  difference  equation  in 
E v " _  ),  for  each  m,  and  has  the  solution 


)  =  B.  F?  +  ...+  E  F,^ 
j  ,  m  1 ,  in  1  x ,  m  k 


(5-5) 


- 1  - 1  - 1 

•..•nere  31  are  constants  and  F.  ,F„  . F  are 

i ,  m  k  t  m  l/w  it 

the  roots  of  the  characteristic  polynomial 


Y(z)  =  l-miz-...-ockzk, 


which  lie  outside  the  unit  circle  by  hypothesis.  From 
(5<5)  the  expected  values,  E(v.  ),  die  out  exponentially 

CQ  J  '  m 

with  j  and  hence  Xj  E(v  .  m)^«ofor  m=l,2 . k.  This  implies 

j=o  J 1® 


oC.  K  oO  K 

££B<vjVk-J  -  (5-6) 


j,m  k-m' 


j-o  tn=) 


since  the  v.  ,  which  depend  on  z,  ,  z.  z  . ,  are  indepen- 

«,  »  -•  K  K  +  i  J 

dent  of  6^ ,  6^ ,  .  .  . ,  £jc_ ^ ,  and  by  hypothesis  6q ’  6i  ’  •  •  •  » 
have  finite  second  moments. 

Now  consider  the  CHARI(p,k)  process  given  by  (3-la.b). 

A  standard  argument  for  the  p-th  order  autoregression  can 
be  applied  to  (3- la)  (see  Karlin  and  Taylor  (6)  ,  for  ex¬ 

ample).  This  gives 


P  +  J  n£0  m  P  +  J~m  j.l^p-l  ?0,pJO 


whir -3  the  recurrence  relations  for  $.  and  jf.  are: 

J  J  » ni 


*1*1  -  h 


j=0, 1, . 


r  =  (j) 

c  0 ,  m  rm 


m=l,2, . . . ,p 


?j  +  lfm  £j,A  +  £j,m+l 


m=l , 2, . . . ,p-l  j=0 , 1 , . . .  (5.5 


E.  =  fc.  ,<p 

n .  p  "] ,  iYp  • 


The  coefficients  can  also  be  obtained  from  the  power  series 
expansion  cf  2  ~(z)  where 


^(z)  =  1-  ^z-.  .  .-(f^zp. 


In  narti 


$  1(z)  =  a™  +  R:(z) 

*  m»o  m  J 


(5.10 


where  the  remainder  R.(z)  is 


v -V.V.VMVMV V-  >  .'.t>  ‘-V-V  ’  . w- V-V-V' .>  •  .tf. S  v 


H,(z)  =  ( £.  1z*^  +  1  +...+  £•  zP  +  J‘)$  1(z) .  (5*11) 

Furthermore ,  if  G~*,...,G~*  are  the  roots  of  <£(z),  which  lie 

cvttide  the  unit  circle  by  assumption,  and  |zkmin|G.  |,  then 

*  1 

the  series  =  Z!  converges  absolutely.  Hence 

m*o  m 

R  (zHC,  as  :-+*>,  for  any  |  z|<  min  Jg7*  I ,  including  z=l.  This 
J  i  1  «o 

implies  that  l-  -> 0  for  m=l,2 . p,  as  j->»,  and  Z.  S  converges 

f  c  ,  r.i  rn«o  111 

absolutely  (see  Karlin  and  Taylor  (6)  for  details). 

Now,  combining  (5-1)  and  (5-7)  gives 


e  yT 


0 

-E*B(£“i)*  zp+o-m]2j 

M--0  1-0  J  J 


(5-12) 


E[(dj,l^p-1  +,->+  ?j,pyO^  J 


r  <;  2  Err(r  ..  +  v 

*-■  rn  ’  l  ~  "i  p+  j-m-k, 

m  -O  u  - 


1  k-1  T3  +  J 


p+j-ra-k,ktO)2  (?  ui)Sj2J 


'  E[(Jj,iy;-i  +"'+  £j,Pyo)2] 


2  2  2 
m  11  ’  p-j-m-k,  l£k-l  +  *’,+  vp+ j-m-k , k60 ^ 


The  first  term  in  the  last  expression  vanishes,  as  if 

y-,y1i...»y_  1  have  finite  variances,  since  \  •  0 ,  m-1,2, . . . ,p. 

The  last  term  is  the  (j+O-st  term  of  the  Cauchy  product  of 

fC  _  eO 

and  ZE(vp+j-k,  l£k-l  +  *  ’  •  +vp+j-k  k60^  and  'therefore  must  also 
converge  to  zero  since  the  Cauchy  product  converges,  as  a 
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consequence  of  Z.U  \/C,°  and  (5-6).  Hence,  the  expectation 

M:0  HI 

(5-12)  converges  to  zero  as  j-**> . 

The  preceding  results  imply  that,  as  j-*00* 


y  .  — >  U 
P  ■  J 


in  quadratic  as a n,  where 


U  = 


lim 

j-*«° 


3 

It 

ro-o 


m 


?ui 


1 

)*i 


p  +  j-m 


(5-13) 


The  distribution  of  U  is  independent  of  the  distribution  of 

yg^ . y  t  and  €0,G1’ 1  •  '  ’  €k-l*  since  the  ty^l  process 

is  obviously  indecomposable,  the  limiting  distribution, 
given  by  (5-13).  is  the  unique  stationary  initial  distribu¬ 
tion  and  the  { y J  process  is  asymptotically  stationary  and 

1/ 

ergodic  (Breiman  (2)  ), 


Proof  of  h ± :  r sa  4 . 1 

Repeated  substitution  of  (4.1a,b)  gives: 


a 

v.  v 


i-'-X 


+  Vo +  +  <WP-i+ 


A*  *.jt  sJkT^rL i  U  f. 


yP+i =  *iKyp-i+---+Vo +  [v/ai(Vp-i+---+Vo)2Ii  zPi 


+  ^2yp-l  +  ^3yp-2  +  **‘  +  +  t/30+/3l(Ct>l(^Lyp-l+  *  ’  ' 


rpyO+  [‘V  ft. '  Vp-1  +  ’  *  '  +  Vo }  ^  Zp]  +^2yp-l+"  *  ,+^pylj?I2  Zp+1 


»  %j 

Vi  *  Ls~i-*  *  *3.iyP-i  *"'*  ?j.Pyo  J*0>1’- 


(5.14) 


where  the  coefficients  S  ,  m=Ofl,...  and  ,  m=l,2,...,p 


are  defined  by  the  recurrence  relations  (5*8)  and  (5-9)  of  the 


previous  proof. 


The  random  variables  w  ,  m=0, are  also  defined 


recursively.  They  are  given  by 


'o  f^0  +  ^l!'^iyp-l  +  *  ‘ ' +^py0^  J 2  zp 


v/j  +  i  =  {£o+2i(?3+i,iyP-i+'  •  <+lj+i,pyo+^+iwo+*  *  *  +  ^iwj)2]2  zp+j+l’ 


(5.15) 


The  w.'s  are  uncorrelated  and  have  mean  zero.  The 
J 


variance  cf  w.  ..  can  be  found  by  squaring  both  sides  of  (5*15) 
J 

and  taking  expectations  to  give 


E ^ 'v j t-1  ^  ‘  ^0  *  ®lE[^j+l,  lyp-l  +  " '  +  ?j  +  l,  ly0^  ]  + 


Sj+iE(»o)  +---+  s?E(wj) 


V  ^  h  f  i*r 


,2''  =  a,.  -*-  [(4>1y^._1  +  •  •  • +4>Dy0)^]  •  Therefore, 


p^O 


j 

Pol?*  + 


rnso 


m*o 


j-m 


j=0, 1, .  .  . 


(5- 


.2  . 


where  <7 .  is  defined  to  be 
J 


2 

Cc-  -  E 

J 


[(  ?j,  lyp-l  +  ‘  *  -+Zj,pyo)2]  3-0,1,  ..  . 


and  the  nonnegative  coefficients  T|.  are  given  by  the  recur- 

J 


rence  relations 


fio  =  1 


^l(Sl71i-l  +  “-+ffjT]0)  o  =  1»2' 


(5. 


Consider  the  power  series  Zi^t  zm.  Equation  (5.17)  im 

m*  o  *n 


plies  that 


eO 


oO 


+  ^1  ~  =  U  (5* 
m-o  i  J-^-o 

>o 

Since  Is  *"zm  is  absolutely  convergent  whenever  I  zl^min  {gT^J 


rr,:o 


I- 


••  .■■ 


t:*. 
'«•  *  * 


.A 

,  ■  • 

V. 


K 


,*» .-. 


F.’-; 


>  *  « 


k' 


;<js 

& 


- . « 
!*.*' 
.N 
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where  G.1,  i=l,2 . p  are  the  roots  of  $(z)  (see  previous 

i  » 

proof),  (-5.18)  implies  that  JE^z"1  is  absolutely  convergent 
if  1  r!^  mj.n|  G~^  ]  and  1  +  |3..  -  |3..£  £2  |z|  m>  0.  In  particular,  for 

^  1  1  J-  J-W»:o  m  O 

s  =  :,En/«if  Note  that  1  +  Ai-Ai?im>0  is 


^quive1  er.t  +  ~  '  l-*-3  • )  (4b  ?« +.  .  . +<f>  fL)  2  1  since  2S 

P  '  P  m=o 


m 


(1-4^  •  .-^fp)"1  where  are  given  by  (2.2). 


It  is  also  easy  to  see  that  First  note  that 

""D  m  ^  DO 

,,  _  ~  •  •  j»  *  *s  ___»_• _ n _ in  /  _  \  #  _ r  _ ^ 

the 


coefficients  £.  .  m=l,2 . p,  satisfy  I  R . (z )  =  L  m$  zr 

,  ra  ]=o  J,.  m*°  m 


where  the  remainder/^was  defined  by  (5.11)*  and  Zl^mS^z111  is 


absolutely  convergent  for  |zpmj.n|G.  |  .  Thus,  for  z=l, 

do  1  1  V  2 

H|(^-  )J^«o  which  implies  that  Z>  cn  2«>  ,  provided 

j=o  1 J  • 1  <  P  3=0  <) 

yQ,y1 . yp_1  have  finite  variances. 


Let  (  x  -i  be  the  random  variables  defined  by 
J 


Ac  ZP 


xj+i 


■  LiS0  +  /3l^.i  +  lxO  +  ' *  ■ +  ^lXP  J 


2ii 


Jp+j+l 


j  =0 , 1 , 


Reseating  -.he  argument  used  to  derive  (5*16), 


E(x!>  -  *>£>.  ■ 


(5.19) 


No 


j 

ow,  consider  E  [*(  y  .  -  liSx.  _)21  .  From  (5*1*0 

*-  P +  .1  ivitfc  1*1  j  ""in  -J 


P  +  J  m*o  ®  0" 
3  ,  3 


E[(Vi  -iiSr»xj-m)2]  *  Of  ‘  x3-ra)Z] 


(5.20) 


The  expectation  of  w.x.  is  nonnegative  and 

J  J 


^  V¥[[(?j,lyP-l+- *  +  ^,py0+ ^jw0+-  •*  +  ^lwj-l) 


;-;(J.x0+...  +  s1x._1)2jy. 


(5.21) 


2  i  2  - 

The  inequality  follows  from  the  fact  that  (^Q+^^a  )2(/30+/3^b  )2 
%  j30+/31(a  b  )2  for  any  real  numbers  a  and  b.  Since 
e[(X2Y2)2]  =  E(1xyI)  |E(XY)J  for  random  variables  X  and  Y, 
(5*21)  implies  that 


E(wjXj)^  ft0  +  P  it  §  jE(  W0X0  ^ +  ‘  ’  *  lE^w  j-lx  j-1  l]  ’ 

This  inequality  and  the  fact  that 

E(woV  =  E^o{V/5i(<t>iyp-i+---+Vo)2JiJ?  Po 

9 

3 

can  be  us  si  a.?  verify  that  E(w.x.)  ^  Eence  follows 

^  "  U  ms© 

from  (5.1 c;  arc  (5-19)  that 

Ef(w.-x.)21^/31ZjY]cr? 

I  J  J  J  1  lm«o’m  j-m 

Substituting  into  (5-20)  and  simplifying,  using  (5.1?)» 
gives 


The  right-hand  side  of  (5-22)  converges  to  zero  as  , 

U>  qq 

e-i-  -=  £yl  and  I]  CT2  both  converge  and  the  right-hand  side 
■  -r.ro  m  Wro  rn 

of  (5. IT .  is  rr.o  (j  +l)-st  term  of  the  Cauchy  product  of  the 

— •  _  -  3  8S 

The  foregoing  arguments  imply  that,  as 


X 


in  quadratic  mean,  where 


X  =  lira  ^  x  . 
j**  wv=o  m  ,l-m 


(5-23) 


The  distribution  of  X  corresponds  to  the  unique  stationary 

initial  distribution  and  does  not  depend  on  . yp-l' 

The  CHARII ip)  process  is,  therefore,  asymptotically  stationary 
an:,  s r gc i i o  ire iman  (2)  ) . 


6.  Conclusions 

The  CHARI  and  CHARII  models  are  two  representatives  of 
a  general  class  of  conditionally  heteroscedastic  autoregres¬ 
sions.  Simulated  sample  paths,  generated  by  the  CHARI  and 
CHARII  processes,  have  a  characteristic  patcfcy  appearance. 
The  processes  possess  several  attractive  properties,  such 


25 


as  a  linear  conditional  mean  and  an  autocorrelation  function 


which  is  the  same  as  the  autocorrelation  function  of  the 


classical  autoregression.  In  addition,  the  processes  can  be 


sho>‘'v  to  be  stationary  and  ergodic  under  a  reasonable  and 


easily  verifiable  set  of  assumptions. 


The  author  wishes  to  thank  R.D.  Martin  for  helpful  sug¬ 


gestions  and  criticisms  of  earlier  versions  of  the  proofs  of 


Theorems  3-1  and  4.1. 
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Figure  Captions 


Figure  1: 


Simulated  sample  paths  of  four  stationary  CHARI 
processes.  The  mean  and  variance  are  the  same 
for  all  four  cases. 


CHARI .1,1) 

<P=-5;  cl0-.:  1,  cL^.9 

•„  \ 

/ 

CHARI (1,1) 

(f)=.9i  cLq=1,  = . 9 

.  :) 

I HAH I (2,1) 

<P2=.2;  of0=1.92, 

oC^  = .  8 

(d) 

CHARI (2, 2) 

4>i  =  --b,  (J)2=.2;  (Xq=  1.92, 

* 

h-* 

II 

Figure  2:  Simulated  sample  paths  of  four  stationary  CHARII 

processes.  The  mean  and  variance  are  the  same 
for  all  four  cases. 

(a)  CHARI  I  ( 1 )  <f>=.5;  P0=.  7,  <3^.9 

(b)  CHARII ( 1 )  <f>=  .9;  £0=.3?33,  (3 1  =  .2 

(c)  CHARII  (2)  <p  =  ~.  4,  4>2=  .  2 ;  ^=2.1333,  0-^2 

(d)  CHARII(2)  4)2=-2;  ^Q=5 - 8666 ,  (i^-1 

7igure  3=  -he  regions  of  stationarity  and  finite  fourth 
moment  for  the  CHARII(l)  process.  The  region 
texween  the  two  outer  curves  is  the  region  of 

p 

stationarity:  (1  +  /3 ^  )$  £1  and  the  region  between 
the  inner  curves  is  the  region  where  the  fourth 

h  p 

moment  exists:  4>  ( l+6(i1+3pp*.  1. 


